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SUMMARY 


In  this  report  we  present  a  bried  description  of  the  research  carried  out 
by  faculty,  staff,  and  students  in  the  M.I.T.  Laboratory  for  Information  and 
Decision  Systems  under  Grant  AFOSR-82-0258 .  The  principal  investigator  for 
this  research  is  Professor  Alan  S.  Willsky.  and  the  co-principal  investigator 
is  Prof.  George  C.  Verghese.  The  time  period  covered  in  this  status  report  is 
from  November  11,  1984  to  November  10.  1985. 

The  basic  scope  of  this  grant  is  to  carry  out  fundamental  research  in  the 
analysis,  control,  and  estimation  of  complex  systems,  with  particular  emphasis 
on  the  use  of  methods  of  asymptotic  analysis  and  multiple  time  scales  to 
decompose  complex  problems  into  interconnections  of  simpler  ones.  During  the 
time  period  covered  by  this  report,  significant  progress  has  been  made  in 
several  areas,  leading  to  important  results  and  to  promising  direction  for 
further  research. 

The  Specific  topics  covered  in  this  report  are: 

I.  Analysis  and  Estimation  for  Finite-State  and  Hybrid  Processes 
Possessing  Time  or  Spatial  Decompositions  ' 

II.  Analysis  and  Control  of  Singularly  Perturbed  tind  Weakly  Coupled 

Linear  Systems  ‘  ^ 

III.  Analysis  and  Estimation  for  Singular  Systems  . 


A  complete  list  of  publications  (completed  auid  in  preparation)  supported  by 
this  grant  is  included  at  the  end  of  this  report. 
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I.  Analysis  £ind  Estimation  for  Finite-State  auid  Hybrid  Processes  Possessing 

Time  of  Spatial  Decomposition 

CXar  work  in  the  past  year  in  this  portion  of  our  project  has  focused  on 
following  through  on  the  two  major  directions  described  in  significant  detail 
in  our  preceding  status  report  and  proposal:  time  scale  decomposition  of 
singularly-perturbed  finite-state  Markov  processes  (FSMP's);  and  modeling  tuid 
estimation  for  spatially-distributed  finite-state  processes.  Since  detailed 
descriptions  of  these  research  projects  are  given  in  the  previous  status 
report  and  proposal,  we  present  here  abbreviated  descriptions,  together  with 
discussions  of  the  progress  made  in  the  last  year. 

Our  work  on  time  scale  decompositions  of  FSMP’s  has  dealt  with  a  model  of 
the  form 

x(t)  =  A(e)x(t)  (1.1) 

where  A(£)  is  an  inf initessimally  stochastic  matrix,  e  is  a  small  parameter, 
and  x(t)  is  the  probability  vector  of  the  FSMP.  In  our  early  work  in  this 
area  [1],  [2],  [4]  we  had  developed  a  general  procedure  for  constructing  a 
multiple  time  scale  decomposition  of  (1.1)  and  for  obtaining  aggregated  models 
at  successively  slower  time  scales.  Specifically,  it  is  straightforward  to 
check  that  A(0)  captures  the  fast  time  scale  behavior  (i.e.  transitions  in  the 
FSMP  that  occur  in  order  1  time  rather  than  1/e  or  longer).  Then,  if  we  let 
P(e)  denote  the  projection  onto  the  eigenspace  of  all  eigenvalues  of  A(e)  that 
are  0(e),  we  can  define  another  matrix 

a^(£)  =  (12) 

so  that  we  can  repeat  the  procedure  at  the  next  time  scale'  i.e.  Aj(0) 
captures  transition  behavior  of  the  original  process  at  the  time  scale  1/e, 
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A^(£)  = 


(1.3) 


contains  all  the  information  on  slower  behavior,  where  P^{£)  is  the 
corresponding  projection  for  A^{e) . 

There  are  several  major  limitations  to  this  previous  work.  Specifically, 
the  calculation  of  the  full  e-dependent  projection  P(£)  is  a  highly  nontrivial 
computation,  without  a  simple  probabilitistic  interpretation.  Furthermore, 
while  the  methods  of  [1].-[1].  [4]  provide  a  procedure  for  ziggregation,  this 
aggregation  is  accomplished  after  the  fact  —  i.e.  the  computations  (2.2), 
(2.3),  etc.  must  be  carried  out  on  the  full  process  and  only  at  the  end  ctm 
one  perform  aggregation. 

This  is  in  marked  contrast  to  results  of  others  which  apply  only  to  a 
rather  restrictive  subclass  of  models  as  in  (1.1).  Specifically,  under  the 
condition  known  as  "nearly  complete  decomposability"  on  A(£)  —  in  which  the 
states  at  each  time  scale  can  be  grouped  into  ergodic  classes  so  that  there 
are  no  transient  states  and  trauisitions  between  classes  occur  only  at  slower 
time  scales  —  one  can  proceed  as  follows.  Note  that  P(0)  is  nothing  moe  than 
the  ergodic  projection  of  A(0).  If  A(£)  is  nearly  completely  decomposable, 


then  (2.2)  can  be  replaced  by 
A  re) 

1'  '  e 


(1.4) 


In  fact,  because  of  the  simple  interpretation  of  P(0)  we  can  go  one  step 
farther.  Specifically,  since  P(0)  is  the  ergodic  projection  of  an  FSMP 


without  transient  states,  it  can  be  written  as 


P(0)  =  UV 


(1.5) 


r 
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where  V  is  a  matrix  of  I's  zmd  O’s.  where  the  I’s  in  a  particular  row 
correspond  to  the  states  that  form  a  single  ergodic  class  in  A{0)  and  where 
the  corresponding  column  of  U  is  the  vector  of  ergodic  probabilities  assuming 
the  process  starts  in  this  class.  From  this  one  can  deduce  that  VU  =1  2uid 
that  the  slow  time  behavior  captured  by  Aj(e)  is  also  captured  by 

P^(^)^YA^  (1.6) 

which  is  a  Markov  generator  on  an  aggregated  state  space  with  one  aggregated 
state  per  ergodic  class  of  A(0)  and  with  transition  rates  between  aggregates 
representing  average  transition  rates  from  states  in  one  ergodic  class  to 
states  in  another,  where  the  averaging  is  done  using  the  ergodic  probabilities 
of  A{0)  (i.e.  elements  of  U). 

As  pointed  out  in  the  previous  status  report,  the  simplified  procedure 
just  described  can  break  down  if  there  are  transient  states,  at  any  time 
scale,  as  the  averaging  implied  by  P(0)  will  miss  potentially  important 
couplings  of  aggregated  states  through  transient  states.  It  is  this 
phenomenon  that  requires  the  retention  of  at  least  some  e-dependent  terms  in 
P{e).  In  our  recently  completed  paper  [16]  (see  also  [12],  [25])  we  have 
succeeded  in  solving  the  same  general  problem  as  in  [1],  [2],  [4]  but  with  a 
far  simpler  procedure  that  maintains  the  advantages  of  the  proceudre  developed 
in  the  nearly  completely  decomposable  case:  the  computations  are 
straightforward,  with  clear  probabilistic  interpretations,  and  at  each  stage 
of  the  procedure  we  work  on  increasingly  s^regated  versions  of  the  original 
process.  The  proof  of  this  result  involves  rather  delicate  arguments  and 
careful  accounting  for  the  dominant  transition  paths  between  states  (and  hence 
there  is  a  graph-theoretic  flavor  to  the  result).  The  end  resullt  of  this 


emalysis  is  that  in  the  general  case,  the  slow  time  scale  behavior  of  (1.1)  is 


i 


captured  by  an  aggregated  Markov  generator 


G,{e)  = 


(1.7) 


where  U  is  as  before,  amd  where  the  "ergodic  class  membership  matrix"  V(e)  is 
now  not  simply  a  0-1  matrix  but  is  in  fact  e-dependent.  This  e-dependence 
captures  the  fact  that  some  transient  states  of  A(0)  may  in  fact  have 
e-dependent  transitions  into  more  than  one  ergodic  class  of  A{0) ,  amd 
therefore  the  "membership"  of  this  class  must  be  split  accordingly.  As 
discussing  in  [16],  the  elements  of  V(e)  can  be  interpreted  and  calculated  as 
trapping  probabilities  of  simplifed  FSMP's  and  in  fact  all  that  is  needed  is 
to  make  sure  that  the  leading  order  terms  of  V{£)  match  those  of  the 
corresponding  trapping  probabilities  and  that  the  columns  of  V(£)  all  add  up 
to  1  (corresponding  to  the  "total  membership"  of  each  state  in  the  original 
chain).  The  result  is  a  straightforward  computational  procedure  described  in 
detail  in  [16]. 

The  result  just  described  represents  a  significant  breakthrough  for 
several  reasons.  First,  we  now  have  a  computationally  feasible  method  for 
multiple  time  scale  decomposition  of  FSMP’s,  euid  this  opens  the  door  for  the 
consideration  of  the  application  of  this  theory  to  a  variety  of  problems, 
ranging  from  reliability  analysis  to  analysis  of  networks  of  queues.  Also, 
the  theoretical  machinery  we  have  developed  should  allow  us  to  make 
significant  extensions  of  these  results  —  to  discrete-time  chains,  perturbed 
semi-Markov  processes,  and  to  interconnected  systems  described  as  in  (11)  but 
in  which  A(fc)  is  not  a  Markov  generator  and  x(t)  is  the  state  of  a  system 
rather  than  a  probability  vector.  A  number  of  these  research  directions  are 


elaborated  upon  in  significtuit  detail  in  [25], 

Tile  ocher  portion  of  our  research  during  the  past  year  focused  on  the 
development  of  a  modeling  methodology  and  estimation  strategies  for  extremely 
complex  event-driven  systems.  As  discussed  in  our  preceding  status  report, 
the  modeling  of  cardiac  activity  and  electrocardiogram  (EOG)  analysis  provided 
us  with  an  excellent  context  for  this  study,  since  distributed  models  of  the 
heart  and  the  ECX5  analysis  problem  capture  many  of  the  key  features  found  in 
numerous  applications  involving  complex  signal  analysis  or  the  monitoring  of 
distributed  systems.  Specifically,  our  work  has  focused  on  the  modeling  of 
coordination,  or  more  specifically  timing  and  control,  in  interconnected 
systems  and  on  the  development  of  distributed  estimation  structures  for  such 
systems.  The  latter  problem  has  as  a  major  component  the  design  of 
coordination  strategies  for  the  processors  charged  with  monitoring  individual 
subsystems.  A  second  major  problem  we  have  addressed  in  our  investigation  is 
the  development  of  meaningful  measures  of  performance  for  such  event-oriented 
estimation  problems. 

During  the  past  year  we  have  completed  a  major  research  project  in  this 
area.  This  research  is  described  in  the  Ph.D.  thesis  [10].  Also,  we  have 
completed  one  paper  [15]  detailing  our  approach  to  constructing  distributed 
models  of  cardiac  activity,  and  a  second  p>aper  [18]  describing  our  methodology 
for  the  design  and  performance  evaluation  of  distributed  estimators  for  such 
models  of  interconnected  systems  is  in  preparation.  A  variety  of  directions 
for  further  research  have  been  identified  tmd  documented  [10]. 


II.  ,\r.alysis  and  Control  of  Singularly  Perturbed  and  Weakly  Coupled 

Linear  Systems 

A  major  part  of  our  research  has  been  devoted  to  developing  an  algebraic 
approach  to  the  study  of  time-scale  structure  in  perturbed,  linear, 
time-invarizuit  systems  of  the  form 

x(t)  =  A{e)x(t)  +  B{e)u{t)  (2.1) 

where  x  is  the  N-dimensional  state  vector,  u  the  m-dimensional  vector  of 
control  inputs,  and  e  a  (small,  positive)  perturbation  parameter;  the  entries 
of  A(fc)  and  B(e)  (as  well  as  of  other  functions  of  e  that  are  introduced 
Inter)  are  taken  from  the  ring  of  functions  of  e  that  are  analytic  at  0.  Our 
accomplishments  so  far  in  this  direction  are  contained  in  the  recently 
completed  thesis  (9].  A  summary  of  those  results  of  the  thesis  obtained 
during  the  last  year  is  presented  first. 

A  second  focus  for  our  work  in  this  past  year  on  systems  of  the  form 
(2.1)  has  been  the  study  of  their  orders  of  controllability.  Considerable 
progress  has  been  made  on  questions  we  raised  earlier  in  this  regard,  and  this 
is  summarized  in  the  remainder  of  the  section. 

1.  Time-Scale  Structure 

Consider  first  the  undriven  form  of  (2.1),  namely 

x(t)  =  A(e)x(t)  (2.2) 

Assume  A(£)  to  be  Hurwitz  for  e  in  (Q.c^];  the  extension  to  the  more  general 
case  where  A(fc)  is  semistable  is  described  in  [9].  If  A(0)  is  singular,  the 
system  (2.2)  is  termed  singularly  perturbed,  because  some  eigenvalues  that  are 
nonzero  for  a  =  0  become  0  at  e  =  0,  causing  the  matri.x  A(e)  to  become 


V-  ■ 
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singular  at  e  =  0.  We  consider  only  this  singularly  perturbed  case  in  this 
section. 

There  has  been  much  interest  in  the  question  of  when  (2.2)  has 
well-defined  time-scale  structure,  as  defined  by  Coderch  et  al .  in  [1].  The 
objective  is  to  expose  and  exploit  this  structure  by  obtaining  a  time-scale 
decomposition  of  the  system.  It  was  shown  in  [4]  that  (2.2)  has  well-defined 
time-scale  structure  if  and  only  if  A(e)  satisfies  a  so-called  multiple 
semistability  or  MSST  condition. 

Our  algebraic  approach  to  this  problem  begins  by  performing  a  unimodular 
similarity  transformation  of  (2.2): 

x(t)  =  P(6.)y(t),  det[P(0)]  =  nonzero  constant  (2.3) 

The  above  condition  on  P(£)  causes  it  to  be  a  well  behaved  transformation 
at  e  =  0,  because  its  Inverse  is  well  defined  there.  P(£)  is  chosen  such  that 
the  transformed  system  takes  the  so-called  explicit  form 

y(c)  =  D(6)A(6)y(t)  (2.4) 

where  A(fc)  is  also  unimodular.  l.e.  det[A(0)]  =  nonzero  constant,  and  where 

D(£)  =  diag  .  ^*°"^in^  '  <...<  kn  (2.5) 

The  diagonal  elements  of  D(fc)  are  the  invariant  factors  of  A(e).  The 
e.xistence  of  a  Smith  decomposition  for  any  A(e)  that  has  entries  analytic  at  0 
is  what  guarantees  the  existence  of  such  a  transformation. 

What  underlies  many  of  our  results  now  is  the  idea  that,  since  A(fc)  is 
nonsingular  at  e  =  0.  ztny  time-scale  structure  of  the  system  (2.4)  must  be 
explicitly  displayed  by  the  matrix  D(e).  (This  would  be  trivially  true  if  we 
had  A(£)  =  I.)  This  time-scale  structure  should  in  turn  reflect  that  of  the 
underlying  system  (2.2).  because  the  transformation  matrix  P(e)  is  unimodular. 
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Carrying  the  same  idea  one  step  further,  one  might  believe  that  significant 
error  w;,i.  not  be  incurred  if  A(fc)  in  (2.-1)  is  replaced  by  A(0) ,  yielding  what 
we  call  the  reduced  explicit  form  of  (2.2): 

z{t)  =  D(£)A(0)z(t)  (2.6) 

The  results  below  show  to  what  extent  these  intuitive  expectations  are 
fulfilled. 

Let  A(0)  in  (2.6).  henceforth  represented  simply  by  A.  be  partitioned 
conformably  with  D(e): 


A  = 


12 


In 


2n 


nl  •  ■ 


...  A 


nn 


(2.7) 


Denote  the  Schur  complement  of  A^^  in  A  by  Cp^.  and  let  its  leading  block 

entry  be  denoted  by  ^~'^22~^21^1 1  ^^12^  ‘  ^33  denote  the  Schur 

complement  of  A^p  in  .  and  denote  its  leading  block  matrix  entry  by  A^^- 

Construct  A. .  for  i  >  3  similarly.  It  is  then  shown  in  [9]  that  A(fc)  in  (2.2) 

satisfic:.  the  MSST  condition  of  [1]  if  and  only  if  all  the  A.,  for  i  >  1  are 

11 

Hurwitz  (where  A^^  =  A^^.  Furthermore,  the  multiple  semi-simple  null 

structure  or  MSSNS  condition  of  [1]  is  shown  to  be  equivalent  to 

nonsingularity  of  the  A.^.  Under  the  MSST  condition,  we  have  shown  how  to 

construct  a  constant  matrix  T  such  that 

1 im  sup  ||exp{A(fc)t}  -  Texp{A(fc)t}T  ^|1  =0 
fc-O  t>0 


(2.8) 


where 

A^,c.}  =  Giag  . 

This  leads  directly  to  an  explicit  time-scale  decomposition  of  the  system 


(2.2). 

Last  year's  proposal  noted  that  we  seemed  to  have  ready  the  seeds  of  am 
extension  of  time-scale  decomposition  ideas  to  systems  that  do  not  posses 
well-defined  time  scales  in  the  sense  of  [1].  An  importaint  accomplishment  of 
our  research  in  this  past  year  has  been  to  obtain  results  along  these  lines, 
fulfilling  the  expectations  listed  last  year.  To  see  the  issues  involved, 
consider  the  following  example. 

Examp 1 e  1  Suppose 


A(e) 


f-fc-e  1 


-1 


2 


-e-£ 


(2.10) 


Here  A(£)  is  already  in  explicit  form,  and 


A^i  =  A{0)  = 


0  1 
-I  0 


(2.11) 


is  nonsingular  but  (unlike  A(e)  for  small  positive  t)  is  not  Hurwitz.  In 

other  words,  A(fc)  satisifes  the  MSSNS  but  not  the  MSST  condition.  The 

associated  system  (2.2)  therefore  does  not  have  well-defined  time  scales  in 

the  sense  of  [Ij,  and  there  is  no  constant  matrix  Aq  such  that 

1  im  sup  II  e.xp(  A(fc  )  t }  -  Texp{A^t  }T  ^  |  |  =  0 
e-O  OO  ^ 


(2.12) 


The  problem  is  that  the  system  has  a  dampling  of  order  higher  than  its  natural 
oscillation  frequency,  so  that  its  solutions  are  of  the  form 

-  r- 

x.(t)  =  e  ^  ^  'sin(t+0)  (2.13) 

If.  however,  we  used  the  e-dependent  matrix 


Ao(e) 


(2.14) 


instead  of  Aq  in  (2.12),  we  would  find  that  the  equality  now  does  hold. 

The  above  example  suggests  that  if  we  keep  some  e-dependent  terms  in  our 
system  we  may  obtain  valid  time-scale  decompositions  even  if  the  system 
satisifes  only  MSSNS  and  not  MSST.  Following  up  on  this  idea,  we  shall  say 
that  the  system  (2.2)  has  extended  well-defined  time  scales  if  there  exist 
unimodular  matrices  A^(fe).  i  =  1  to  n,  and  a  constant  invertible  matrix  T  such 

A 

that  (2.S)  holds,  with  A(£)  now  defined  by 

A(£)  =  diag  (fe'^\^(e) . £'“'Aj^(£)}  (2.15) 

instead  of  by  (2.9).  Note  that  (2.8)  and  (2.15)  then  lead  directly  to  the 
e.xtended  time-scale  decomposition.  The  thesis  [9]  describes  how,  under  the 
assumption  that  A(£)  satisfies  MSSNS  (and  with  the  steinding  assumption  that  it 
is  Hurwitz  for  a  range  of  e  >0).  one  can  always  obtain  such  an  extended 
time-scale  decomposition. 

Our  work  over  the  last  year  has  also  rounded  out  several  of  our  earlier 
results  on  e-dependent  amplitude  scaling  of  systems  of  the  form  (2.2)  in  order 
to  achieve  MSSNS  in  systems  that  do  not  already  satisfy  this  condition.  The 


importance  of  MSSNS  is  clear  from  the  above  results  on  extended  time-scale 


decomposition.  Furthermore,  we  have  earlier  shown,  see  [12],  that  under  MSSNS 

k  ’ kn'" 

one  can  approximate  the  eigenvalues  of  A(e.)  via  those  of  e  . . e  A 
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where  the  matrices  A.^  are  as  defined  above.  The  thesis  [9]  describes  a 
systematic  scaling  procedure,  along  with  certain  conditions  sufficient  to 
ensure  that  the  procedure  results  in  a  MSSNS  system.  Though  the  sufficient 
conditions  are  rather  strong  (reflecting  what  we  believe  to  be  the  intrinsic 
difficulty  of  the  problem),  we  have  found  that  they  are  applicable  to  the 
sorts  of  high-gain  feedback  problems  considered  by  Stinnuti  and  Wason  ( TFFF. 
Trans.  Auto.  Control.  AC-30,  7,  633-644,  July  1985),  for  example. 

2.  Orders  of  Controllability 

Major  progress  has  been  made  during  the  last  year  on  the  problem  of 
defining  and  understanding  the  structure  and  significance  of  "orders  of 
controllability"  in  systems  of  the  form  (2.1).  We  believe  we  have  now  found  a 
sound,  satisfying  and  self-consistent  definition  of  this  notion,  and  this  will 
be  outlined  here.  Our  development  has  been  carried  out  in  the  context  of  the 
discrete-time  system 

x[k+l]  =  A(e)x[k]  +  B(e)u[k]  (2.16) 

but  a  similar  development  can  be  carried  out  for  the  con tinous- time  model 
(2.1).  (Difference  between  the  considerations  for  discrete-  tind  continuous¬ 
time  systems  may  be  expected  to  appear  when  we  examine  the  interaction  between 
orders  of  controllability  and  feedback  control  of  time-scales). 

We  assume  that  the  system  is  controllable  for  a  range  of  e  >  0.  The  set 


of  states  controllable  (or,  more  correctly,  reachable)  from  the  origin  in  N 
steps,  starting  at  time  k  =  0,  is  given  by 


xCN]  =  Cj^{£)U[N] 


(2.17a) 
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C^U)  =  [B(£).A{6)B{e) . A”'^(£)B(e)] 

and 


U[N] 


u[N-l] 

u[N-2] 


u[0] 


(2.17b) 


(2.17c) 


We  now  say  a  target  state  x[N]=x(£).  with  entries  analytic  at  0.  is 
£^-control lable  if  there  is  a  control  sequence  U[N]  =  U(£),  also  analytic  at 
0.  such  that 

£4(£)  =  Cj^(£)U(£)  (2.18) 

The  following  examples  will  help  to  make  this  definition  more  concrete. 
Example  2  Suppose 
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It  is  then  evident  that  the  target  state  [1  0]  is  £  -controllable,  while  the 

T  1 

target  state  [1  1]  is  only  e  -controllable.  (In  the  limit  of  £  =  0,  of 


course,  the  first  target  state  remains  controllable  while  the  second  target 
state  is  no  longer  controllable.) 

Example  3  If.  in  A{£)  of  the  above  example,  we  change  the  e  to  -£.  then 


S(e) 


1  1+e' 

,£  £ 


TO  T 

We  now  find  that,  while  [1  0]  is  still  £  -controllable,  the  target  [1  1] 

2 

is  only  e  -controllable. 

The  set  of  £^-control lable  states  is  denoted  by  ,  and  constitutes  the 
£ •^ -control lable  submodule:  it  is  A(£)-invariant.  The  following  inclusion 
property  is  then  evident  from  the  definition: 

X°<1.X^C....  (2.19) 

We  have  shown  that  the  structure  of  these  submodules  is  determined  by  the 
invariant  factor  structure  of  Cjj(e),  i.e.  by  the  Smith  form  of  Cjj(£).  As  with 
our  time-scale  studies,  therefore,  we  are  very  naturally  led  to  an  algebraic 
characterization  and  study  of  the  problem.  To  see  the  reason  for  the  role  of 
the  Smith  form,  let 

Cj^(£)  =  R(£)M(£)Q(£)  {2.20a) 

be  the  Smith  decomposition  of  C^(£),  where  R{£)  auid  Q(£)  are  unimodular 
matrices,  and 

M(£)  =  [M{£)  0],  {2.20b) 

M(£)  =  diag  .  ^^^^mp^  .  si  <  . . .  <  sp  {2.20c) 

The  structure  of  the  £^-control lable  submodules  can  then  be  read  off  directly 


from  the  matrix  R{£)M{£).  Rather  than  describing  this  here  in  general 


notation,  we  simply  illustrate  the  results  on  the  two  examples  above. 
£.xa.T,'jle  2a  For  Example  2  we  have 
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as  the  Smith  decomposition  (2.20a).  We  then  have  an  e  -controllable  submodul 


of  the  form  [x^{e)  ex2(e)]  .  where  Xj^(£)  and  x^Ce)  are  analytic  at  0  but 
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otherwise  arbitrary,  and  an  e  -controllable  submodule  of  the  form  [Xj{£) 

X2(Of 


Example  3a  For  Example  3  we  have 
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0  2  1 
There  is  now  an  &  -controllable  submodule  of  the  form  [Xj^(£)  eXj(fe)+e  XgCfe)] 

1  2 
an  £  -controllable  submodule  of  the  same  form,  and  an  £  -controllable 

T 

submodule  of  the  form  [Xj(e)  X2(£)]  . 

The  Smith  decomposition  also  allows  us  to  transform  the  original  system 
(2.16)  into  a  standard  form  of  the  type  that  vras  conjectured  in  our  proposal 
last  year  (written  below  for  the  case  where  si  =  i-1,  to  keep  the  notation 


P  V'  i  >  A  f  '  P  '  ^  >  - 


A^i(£)  A^2^^)  •••  ^p(^) 

B^(£) 

£.i2i(^;  A22(=-} 

p  ^  r  A  p  '  - 

^32(.) 

eA32(e)  ... 

e\ie) 

• 

(2.21) 

With  this  standard  form  in  hand,  we  are  in  a  position  to  more  simply  discuss 
issues  such  as  eigenvalue  placement  by  state  feedback.  The  eigenvalues  of 
A{£)  are  clustered  around  those  of  the  A.j^(fc)  in  (2.21)  above.  It  turns  out 
now.  as  might  be  expected,  that  the  eigenvalues  of  A.^{£)  can  be  shifted  by 
0(1)  using  state  feedback  if  and  only  if  we  use  feedback  gains  that  are 
0(e^  ^).  We  have  obtained  an  algorithm  to  pick,  in  a  way  that  is  directed  by 
the  system  structure,  a  feedback  gain  that  effects  a  shift  of  all  the 
eigenvalues  to  desired  positions. 

We  believe  the  road  is  now  open  for  several  useful  and  interesting 
results  to  be  obtained,  aimed  at  structuring  the  design  and  implementation  of 
feedback  control  in  accordance  with  (not  only  time-scale  structure  but  also) 
the  orders  of  controllability  of  the  system.  Directions  for  further  research 
in  this  vein  are  discussed  in  the  accompeinying  proposal. 


i 
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III.  Singular  Systems 

During  the  past  year  we  have  continued  our  research  on  the  class  of 
discrete-time,  boundary-value  singular  models  of  the  form 

Ex(k+1)  =  Ax{k)  +  Bu(k)  (3.1) 

V  =  VqX(O)  +  Vj,x{N)  (3.2) 

In  the  year  preceding  this  past  year  we  had  made  significant  progress  in 
analyzing  the  estimation  problem  for  such  systems,  and  this  analysis  raised  a 
number  of  open  questions  that  related  directly  to  the  fundamental  properties 
—  well-posedness,  stability,  minimality,  etc.  —  of  models  of  this  type.  For 
this  reason  we  focused  most  of  our  efforts  during  the  j>ast  year  on  the 
development  of  a  complete  system  theory  for  models  as  in  (3.1),  (3.2),  and  in 
this  area  we  have  made  substantial  progress.  Our  results  in  this  area  are 
outlined  in  the  S..M.  thesis  proposal  [24]  and  will  be  described  more 
completely  in  the  completed  thesis  and  in  a  paper  to  be  written  on  this 
subject . 

One  of  the  basic  results  we  have  obtained  and  used  heavily  in  our  work  is 

the  following.  Suppose  that  (zE-A)  is  a  regular  pencil  (i.e.  its  determinsint 

is  not  identically  zero).  Then  (3.1)  (3.2)  is  well  posed  if  and  only  if 
N  N 

(VqE  +  Vj^A  )  is  invertible.  In  this  case,  we  can  always  put  the  system  in 
standard  form,  so  that 

VqE^  +  =  I  (3.3) 

oE  +  13A  =  I  (3.4) 


for  some  pair  of  real  numbers  a  and  p  (note  that  (3.4)  implies  that  EA  =  AE) . 

This  result  by  itself  answers  an  important  question  posed  in  our  previous 
proposal,  and,  more  importantly,  it  has  opened  the  way  for  the  development  of 


a  complete  theory  for  this  class  of  systems.  In  particular,  we  have  developed 
results  for  controllability,  observability,  2ind  minimality  for  these  systems. 
While  previous  efforts  have  produced  results  on  these  concepts,  they  are 
significantly  different  from  our  results  for  two  reasons.  The  first  of  these 
is  that  our  use  of  standard  form  allows  us  to  obtain  far  more  compact  and 
easily  understood  conditions  using  a  generalized  Cayley-Hamilton  theorem  for 
regular  pencils  in  standard  form.  The  second  is  that  our  investigation  of 
discrete-time  singular  models  is  unique  thanks  to  our  inclusion  of  the  general 
boundary  condition  (3.2)  (which  seems  to  be  the  natural  choice  given  the 
intrinsic  noncausality  of  (3.1)}. 

An  important  property  of  the  class  of  systems  described  by  models  as  in 

(3.1) ,  (3.2)  is  that  they  require  two  notions  each  for  controllability  and 
observability.  In  particular,  we  can  define  an  inward  boundary  process 
obtained  by  using  the  original  boundary  condition  (3.2)  and  the  inputs  near 
the  boundary,  i.e.  u(k),  k  e  [0,  k^) (k^ ,N-1]  to  propagate  the  boundary 
conditions  in  to  corresponding  constraints  on  x(kQ)  auid  x(kj^).  Similarly,  we 
can  define  a  map  propagating  outward  from  the  center  of  the  interval.  Using 
these  constructions,  we  have  obtained  results  on  controllability  for  each  of 
these  mappings  tuid  for  corresponding  notions  of  observability.  Our  work  here 
has  paralleled  that  of  Krener  in  his  study  of  nonsingular  continuous-time 
boundary-value  models  (i.e.  x  =  Ax  +  Bu,  with  boundary  conditions  analogous  to 

(3.2) ).  although  the  possible  singularity  of  both  E  and  A  leads  to  several 
important  differences  in  our  theory.  An  interesting  and  perhaps  surprising 
part  of  Krener  and  our  theories  is  the  more  complicated  nature  of  minimality. 
Specifically,  minimality  does  not  require  both  controllability  maps  to  be  onto 
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nor  both  observability  maps  to  be  one-to-one.  and  furthermore  alternate 
minimai  realizations  may  not  be  related  by  a  similarity  transformation. 

In  addition  to  the  results  cited  above,  we  have  obtained  further  results 
in  the  case  of  stationary  processes  —  i.e.  models  for  which  the  weighting 
pattern  kernel  from  u  in  (3.1).  (3.2)  to 

y  =  Cx  (3-5) 

is  shift-invariant.  Note  that  this  isn't  generally  the  case  even  with  A.  B,  C 
constant  and  it  in  fact  requires  the  commutativity  of  E.  A  with  and  Vj^. 

Our  development  of  a  system  theory  for  boundary-value  singular  systems 
has  also  led  to  new  results  in  two  additional  areas.  First,  we  have  derived 
and  have  begun  to  analyze  a  boundary-value  Lyapunov  equation  for  stationary 
models  with  u(k)  a  white  sequence  with  covariance  Q  and  v  an  independent 
random  variable  with  covariance  IT.  This  equation  differs  considerably  from 
any  that  have  appeared  in  the  control-oriented  descriptor  literature. 

Once  one  has  a  Lyapunov  equation,  it  is  natural  to  ask  questions  about 
stability  of  models  as  in  (3.1).  (3.2).  However,  stability  refers  to  an 
asymptotic  property  of  a  recursion,  and  this  raises  two  questions:  what  are 
"recursive"  solutions  of  (3.1).  (3.2)  and  how  do  we  deal  with  asymptotic 
properties  when  the  interval  of  interest.  [0.  N].  is  bounded.  We  have  made 
significant  progress  on  both  of  these  questions.  Specifically,  in  [17],  [19] 
we  discuss  a  "two-filter"  solution  to  (3.1),  (3.2)  obtained  by  decoupling 
(3.1)  into  a  causal  and  anticausal  part.  These  two  parts  can  always  be  made 
stable  (in  the  usual  discrete-time  linear  system  sense)  if  |zE-A|  has  no  roots 
on  the  unit  circle.  While  this  is  interesting  (and  is  related  to  previous 
stability  zmalyses  of  descriptor  systems)  it  is  not  completely  satisfying. 
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used  in  previous  work  (on  standard,  non-singular  systems)  to  obtain  recursive 
implementations  of  the  optimal  smoother.  Our  results  will  be  described  in 
detail  in  [19],  Beyond  our  results  to  date,  there  is  much  left  to  be  done  in 
improving  our  understanding  of  the  structure  of  the  estimation  problem  for 
these  systems  and  in  particular  in  analyzing  the  singular  Riccati  equations 
that  arise  in  this  procedure  and  their  relationship  to  the  somewhat  different 
equations  that  have  appeared  in  other,  control-oriented  studies  of  singular 
models.  In  addition,  we  have  continued  our  work  on  estimation  for  2-D 
singular  models.  In  particular  [17]  contains  a  description  of  our  work  on  a 
class  of  such  models  with  sufficient  spatial  symmetry  to  allow  us  to  obtain  an 
extremely  efficient  solution  to  the  smoothing  problem.  This  is  obtained  by 
decoupling  the  dynamics  in  one  spatial  variable  through  the  use  of  a  discrete 
Fourier  transform  and  then  using  the  Hamiltonian  dizigonalization  procedure  to 
obtain  an  efficient  method  for  solving  the  dynamics  in  the  other  variable. 

Much  still  remains  to  be  done  in  this  area  in  considering  more  general  models 
2Uid  in  obtaining  more  efficient  methods  to  account  for  the  effect  of  boundary 
conditions. 
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